United States Army 
Recruiting Command- 



USAREC-SPt85-2. 



DEVELOPMENT AND VALIDATION 
OF PREENLISTMENT 
SCREENING COMPOSITES 
^ FOR 

ARMY ENLISTED PERSONNEL, 

BY 

DONA C. ZIMMERMAN 
RAY A. ZIMMERMAN 
WILLIAM H. KING 

^ly 1985 

Approved for Public Release; 

Distribution Unlimited 



Research and Studies Division 
Program Anolysis ond Evoluotion Directorote 

Fort Sheridon, Illinois 60037 




DEVELOPMENT AND VALIDATION 



OF PREENLISIMENT 
SCREENING COMPOSITES 
FOR 

ARMY ENLISTED PERSONNEL 



by 

Dona C. Ziitmerman 
Ray A. Ziitmerman 
William H. King 



July 1985 



USARBC SR 85-2 



Prepared for: 

US Army Recruiting Command 
Program Analysis and E\^aluation Directorate 
Research and Studies Division 
Fort Sheridan, Illinois 60037 



by 

Manpower Research Center 
Naval Postgraduate School 
Monterey, California 



DISCLAIM)' I 



The views, opinions, end findings in this report are l hose 
oi tl.e autiiors ard should not be construed as an official Depart- 
laent of tie Arniy position, policy, or decision, unless so desicrated 
Ly othe r at' t Iioi i sod documents. 



11 



SUMMARli: 



Background ; Military enlistment standards have been established 
as a means of evaluating the suitability of prospective military 
pc'isonnel. All Volunteer Force (AVI') standards are adjusted 
according to need to enlist Irdividuals who will fill a variety 
of military occupations, and to exclude those with a likelihood 
of failure in completing training or first-term service. First-term 
attrition results in ncn-r ecover able training expenditures, 
affects military readiness, and requires additional expenditure 
for personnel replacement. 

Purpose : One purpose of the study was to identify important 
variables which may be used in preenlistment screening. The 
other was to develc^p and validate composites of the variables 
found to be most predictive of first-term attrition. Sue!) composJt.ts 
could be used operationally to screen out applicants who are high 
risk individuals, in terms of first term attrition. 

Procedure ; Cr oss- 1 abu 1 a t ions of bio-demographic variables 
and attrition status were computed to determine the impact of the 
variables on first-term attrition. Candidate predictors included 
educational level, AFQT category, age at entry, race, term of 
enlistment, moral waivers, marital status, dependent status, 
geographic attrition code, and ASVAB-5 or other ASVAB form. A 
series of logistic regression models were computed using a forward 
selection procedure. The three niale and three female models 
wliich showed the best fit to the data were then selected. 
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Individuals were assigned scores using the coefficients for each 
niode] . Validities cud cr oss-val id i t ies were computed for each 
male and fen ale composite to evaluate its explanatory strength 
and stability incross-validation. The compos ite score distribu ti on s 
were cross-tabulated with actual first-term attrition for population 
subgroups, and were- presented graphically. Composite efficiencies 
were coid[>aied at threfe selected cut-off points on the basis of 
min ind z ing tiie error in prediction of "stayers" who were actually 
first-term lossc?s. The cumulative frequency distributions of the 
conposites' scores were also excunined to determine the number of 
enlistees who would have been eliminated at a given cut-off score. 

Pesul t s : The most significant preenlistment predictors of 
attrition for males were educational level, AFQT category, age at 
entry, geographic attrition code, and race. Term of enlistment, 
AFQT category, and race were the most important predictors of 
first-term attrition for females. The composites which included 
race were the most valid predictors of first-termi attrition. 

Conclusions and Implications ; The composite for males which 
included race as a predictor (Composite 2) provided better predic- 
tions, in general, than the other male composites. Also, the use 
of this composite in preenlistment screening would result in less 
adverse impact for population subgroups than would occur through 
the use of the other composites. The inclusion of race as a 
screening factor inight be perceived negatively or as a source of 
discriminatory action. However, atirition rates for blacks are 
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considerably lower, on the average, than those of their non-black 
cohorts. It would, therefore, be more discriminatory to ignore 
these differences and thereby deny entry to black applicants who 
may appear to be higher attrition risks on the basis of other 
screening criteria. 

Similar findings were obtained for the feniale composite 
including race (Composite 2). However, none of tlie composites 
for feniales provided the level of accuracy in predicting first-term 
attrii Ion than was evident in the male composites. Thus, the 
examination of other variables predictive of female first-term 
attrition would be desireable, since the variables currently 
available for preenlistment screening do not provide as effectual 
attrition predictions for females as for males. 

In addition, attrition may not be the sole criterion of 
int. crest for preenlistment screening. Therefore, a secondary 
fcreening criterion could be developed to estimate an individual's 
ability to achieve minimally acceptable perfc-rinance. This scale 
could be developed on the basis of Skill Qualifications Test 
(SQT) performance, performance ratings, or attainnient of the E-4 
paygrade. Once a measure of expected performance wfjs established, 
it could be used as a final filter in conjunction with the measure 
of expected attrition. 
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FOKKKOKI) 



The research reported here vas sponsored by the U. S. Army 
Recruit ing Comniand . The report provides information on development 
and validation of selection procedu/es which may be employed for 
suitability screening. These data may be updated and the pro- 
cedures revised for operational use. 

The Statistical Analysis System (SAS) software, used in this 
study, has been designed for use with an IBM computer. However, 
similar programming routines are available with packages such as 
SPSS-X for use on ether computer systems. 

File extractions, concatenations, and recoding procedures 
were done by William H. King of BDM Corporation, utilizing Fefense 
Manpower Data Center (DMDC) software. Mary Ellen Lathrop assisted 
in ttie preparation of this report. Supplementary literature was 
provided by Mark J. Fitelberg. 
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I. JNTPODUCTJt)N 



. Background 

Military enlifitnent standards liave been established as 
a means of evaluating the suitability of prospective military 
personnel. The screening procedure has teen altered and has 
become noie comprehensive over the years. Enlistment standards 
are adjusted according to wari Imt- or peacetime needs. During 
wartime mobilization, manpower quantity is preferred to manpower 
quality. However, since the advent of the All Volunteer Force 
{AVF} in 1972, the focus has been on recruiting sufficient numbers 
of "quality" personriol . The Services set their entrance standards 
so as to tnlist the largest number of individuals who will be 
eligible to fill a wide variety of military occupations and 
who will complete their first terms of service. Alternatively, 
entrance standards are set to eliminate applicants who have 
a strong likelihood of failure to complete training or i first 
term of s« r vice . 

First-term attrition, i. e. failure to complete an initial 
t o) III of active duty service, affects military readiness and 
iitcess itates additional expend ituxe for personnel replacement. 
Further, recruitment and training costs invested in those who 
separate early are non-recoverable (sunk costs). Therefore, it 
if- advantageous to assess the utility of using pre-service factors 
related to first-term attrition to predict premature separation. 



P. Pur{)ose 



The putpo£^e of this study was two-foid. First, preenl i stment 
factors available for analysis were examined to identify important 
var lobles which could routinely be used in screening. Second, 
several screening corni^os i tes were developed on an estimation 
sample and v,,lidat€'d on other accession cohorts c.s well as on 
population subgroups. Tj e composite with the best overall efficiency 
ct>uld then be used by tiiC' Army to improve recruit screening when 
supply exceeds den and and to aid in establishing the level of 
trade-off between recruiting resources and training costs. As an 
add i t i onal benef i t , attritif-n forecasting, essential to control ling 
manpower strength, could cilso be improved. 

A recent Rand Defense f'anpower Research Center report reiter- 
ates. the two types of employee attrilutes, screening or pre-service 
characteristics ar d ffifoimance i.uasures. The ASVAB and 
preenlistiirejit physical tests do not screen for important psycho- 
logical adjustment to tht’ rolitary environment. Although this is 
true, a screening device can only be composed of information 
available at the time of application which is uniformly collected 
for all applicants. Therefore, this study was confined to the 
analysis of readily available biographic and demographic pre- 
enl i?;i rent data. 



2 



I]. CONCEPTUAL FRAMEWORK 



Hand, Griffith and Mobley (1977) assert, "Pre-end of first 
term attrition cannot be evaluated in a vacuum. The cost and 
end-strength implications of attrition must be viewed in the 
context of; the size of the pool of potential accessions; success 
of recruiting efforts in attracting qualified accessions within 
the all volunteer environment; and, reenlistment rates. Further, 
evaluation of attrition depends upon, among other things, the 
petfotniance of those being prematurely separated; whether attrition 
is occur ring early in the term of enlistment when sunk costs 
are relatively low or later in the term when replacement costs 
are high; and the marginal costs of attempting to "salvage" 
a candidate for prem.ature separation." 

Several factors are related to first-term attrition which 
include pre-service biographic and demographic characteristics 
as well as military experiences. I.ockroan (1975), Greenberg 
and McConeghy (1977), Flag, Wilkins and Phelan (1968), and Guinn 
(1 977) have found that formial educational level is the most 
important biographic variable related to first-term attrition. 
Matthews (1977) and Guinn (1977) identified mental categories 
as defined by the Armed Forces Qual i f icat ion Test (AFQT) to 
be related to early attrition. Eitelberg, Laurence, Waters 
and Perelman (1984) Ijave found that the annual proportion of 
examinees within each AFQT category has hardly varied over the 
past twenty years despite the switch from draft procedures to 
an all volunteer force. In fact, ". . . . changes in the €‘Conomy, 
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recruitircj jrcentjve£, and policy during the AVF have not operated 
to alter the ” a t t i ac t i venoss" of military service for any one 
pcuijculc.r aptitude category over another; all categories have 
been equally affected by the influencing factors of the 1970s." 
(Eitelberg et al., 1984, p.47). Furthermore, test experts agree 
that the Armed Services Vocational Aptitude Battery (ASVAB) , 
of which the AFQT is composed, is a valid predictor of ir-service 
performance for all groups regardless of gender or race-ethnicity. 
A nonlinear age and attrition relationship has beer reported 
by Flag, Goffnian and Phelan (1970), Guinn (1977), Lockman (1975) 
and Matthews (1977). lockman has incorporated these varicibles 
to form the SCBKEN table used by the Navy for pr eenl istment 
screening of male applicants. These three key variables, highest 
level of education com.pl eted, AFQT category and age at service 
entry were used to develop new Navy screening composites (Flyer and 
Zimmerman, 1984). 

Other preenlistment factors relating to satisfaction with 
military service and early sepjaration have been investigated. 
These include occupational preferences end subsequent training 
(Kat? and Schneider, 1972); preenlistment expectations; alternative 
civilian employment opportunity, attraction to a m.ilitary role 
(Mobley, Hand and Logan, 1977); and marriage and parents' socio- 
fconondc status (McDonald and Gunderson , 1 974) . 

Moral waivers have been studied in relation to enlisted 
miilitary performance. Means (1983) notes that differences in 
waiver policies across Services likely reflect the Services' 
experiences with attrition rates and waivers rather than differing 
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concepts of moral fitness. Since the late 1970s, twelve to 
eighteen percent of all non-prior-service (NPS) accessions have 
entered with moral waivers. Current analysis indicates that 
repeated minor offenses may be predictive of misconduct during 
one's term of enlistment and of subsequent prenature discharge. 
Means (1983) also claims that those entering service with a moral 
waiver are only slightly more likely to be separated from service 
for failure to meet minimum behavioral or performance standards. 
This indicates that either offense history is irrelevant for 
predicting success in the military or that the screening process 
successfully bars unrehabilitated people from service. Probably 
those with the greatest likelihood of failure are screened out. 

In addition to criminal convictions, histories of discipline 
or adjustment problems not resulting in a criminal record may 
be predictive of early attrition. Several emotional adjustment 
and background scales have been developed and studied which 
iiave aimed at identifiying personality traits associated with emo- 
t ional instability. Some of these scales and subscales are 
Prediction of Emotional Instability (PEI), Prediction of Drug Use 
Admission (PDA) of the History Opinion Inventory (HOI), Delinquent 
Behavior Inventory (DBI), California Psychological Inventory 
(CPI) and the Educational and Biographical Information Survey 
(EBIS) . Differences in responses to these inventory items have 
been shown to be statistically significant for first-term stayers 
and leavers. 

Numerous pre-service demographic variables related to attri- 
tion have been studied by Flyer and Elster (1983) v/ho discovered 
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that race, geographic area of residence and the amount of time 
spent in the Delayed Entry Program (DEP) are also predictors of 
early attrition. They provide descriptive statistics for over two 
million male and female accessions during fiscal years (FY) 1973 
to 1978. 

One major finding is that black males, in general, had lower 
attrition rates than non-black males. Similarly, attrition rates 
for black females were lower than those of non-black females in 
all services. The relationship between AFQT scores and attrition 
is weaker for black males than for non-blacks. Black women were 
less often discharged for pregnancy or performance reasons than 
non-black women. 

Secondly, geographic area of residence was also examined 
by aggregating states into census regions. Composites of race, 
gender and geographic regions were formed indicating differences 
in regional attrition rates. Flyer and Elster (1983) cited 
the following differences; lower non-black male attrition in 
the West North Central and Western District; higher non-black 
male attrition in the East and West South Central Regions; low 
black male attrition in the South Atlantic Region; and higher 
black male attrition in the East and West North Central Regions. 
Similar patterns emerged for women. 

Finally, cross-tabular computations have shown that the 
amount of time spent in a Delayed Entry Program is a predictor 
of early separation. The relationship appears to be linear 
and negative, with those participating in the DEP for several 
months more likely to remain in the service. Several possible 
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expJcinaiions exist for this finding. One explanation may be 
that individuais who enter the DEP as high school seniors (and 
cu e pernitted to te^nain in the DEP up to one year) are expressing 
inteiest in military careers or desire military occupational 
training. Another explanation could be that pre-indoctrination 
and exposure to military organizational practices ore beneficial 
to individuals who are forming perceptions and expectations 
of future miilitary life. Grissnset and Kirby (1984) posit that 
a better job searc)) process and an infornied enlistmient decision 
will result in fovv( r negative experience attributes. 

To summarize, a number of pre-accession variables have been 
sdu)V\n to be predictive of prenature first-term separation. These 
include educational level, AEQ!' category, age at entry, race, 
term; of enlistment, ASVAB test taken for entry, dependent status, 
marital status, tim.e spent in the Delayed Entry Progran:, waiver 
explanation, and geographic attrition code based on the enlistee's 
area of residence prior to enlistment. 
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A • 0 c* 1 c' 

The date wei e obtained fiom tlie Cohort Fi3e and the Master 
and Loss Edits nia int a ined by the Defense Manpower Data Center 
(DMnC) in Mcu'teiey, Californic.. Ther.e records are updated with 
delta fiom t tie Military Entrance and Processing Coirntand (M.EPCOM.) 
on a quail erl^ basis. All of the biogra[hic and denicgrophic 
data used in this study are mctintained in these two files. 

B . Popul at ion 

The populcition consisted of approx iniat ely 307,000 Army male 
^^ccesEions from FY 1975 to FY 1982 and over 51,000 Army female 
accessions f r oni FY 3 979 to FY 1 982. Table 1 shows the overall 
male and female attrition rates by fiscal year and term of enl ist- 
nent. The population was initially divided into male and female 
estin'cition f.anples of FY 1975 and FY 1980 accession cohorts. 
The screening composites developed for this sample were 
cross-validated on FY 1981 and FY 1982 cohorts, and compared to 
each othei to examine their stability over time. 

C. Variables 



Cross- tabul ar analysis of each potential coriposite variable 
(predictor) and three-year attrition status (criterion) w£iS 



8 



